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METHOD FOR HIDING A REFRESH IN A PSEUDO-STATIC MEMORY 
Field of Invention 

5 A method and system for hiding, from an external memory controller, a 

refresh operation (or plural refresh operations) in a pseudo-static memory 
device. 

Background of the Invention 

A variety of memory devices are presently available with varying 
10 characteristics. Dynamic Random Access Memory (DRAM) has the 
advantage that the number of gates per cell is small and the density is 
generally quite high. On the other hand, DRAM is disadvantageously prone to 
data loss if the individual rows of data are not periodically refreshed. 
Accordingly, known systems have used external or internal refresh circuitry to 
15 prevent data loss. External circuitry complicates the design of an external 
memory controller and may therefore be disadvantageous. DRAMs 
disadvantageously have relatively long array cycle times as compared to 
other memory devices (e.g., static memories) and therefore may act as a 
bottleneck for a processor that requests memory more quickly than the DRAM 
20 can provide it. 

As an alternative, Static Random Access Memory (SRAM) devices 
utilize a greater number of transistors per memory cell and, as a result, do not 
require refreshing. Moreover, the transistor interconnections allow data to be 
read from and written to the device significantly more quickly than DRAMs. 
25 Unfortunately, the cost of SRAMs per bit is significantly more expensive than 
the cost of DRAMs per bit. Accordingly, it is often prohibitively expensive to 
use SRAM for a computer's main memory, and instead a small amount of 
SRAM is used only for a memory cache between the processor and a larger 
amount of DRAM. 

30 As an alternative to both DRAM and SRAM designs, hybrid memories 

have been introduced that have some of the characteristics of both DRAM 
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devices and SRAM devices. One such device is known as an "Enhanced 
DRAM" (ED RAM) and is described in U.S. Patent Numbers 5,887,272, 
5,721,862, and 5,699,317 (hereinafter "the '272 patent," "the '862 patent", and 
"the '317 patent," respectively), each naming Sartore et al. as inventors. 
5 (Those inventions have been assigned to the parent company of the assignee 
of the present invention.) The ED RAM devices disclosed therein provide 
increased data throughput by providing at least one row register (i.e., a read 
cache) associated with each DRAM sub-array or with each group of DRAM 
sub-arrays. Although an EDRAM device can achieve the higher data rate, 

10 resembling SRAM access speed, for accesses to data stored in the row 

register, an EDRAM device still requires externally initiated refresh operations. 
Column 15, lines 42-56, of the '272 patent discloses that an external signal 
labeled 7F" controls a refresh cycle. This characteristic requires the use of a 
memory controller that understands the operation of EDRAM devices and, 

15 thus, disadvantageously includes the additional circuitry for initiating those 
refresh cycles. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a memory device with 
faster access speed than a conventional DRAM device but without (1) the 
20 cost of a pure SRAM device and (2) the need for an external memory 
controller to initiate refresh cycles. 

This object and other advantageous effects are achieved using a 
pseudo-static memory device that substantially hides all refresh operations 
from a memory controller coupled to the pseudo-static memory device. In a 

25 first embodiment, such a device internally includes a set of DRAM sub-arrays 
(matrices) each having plural array rows, such that at least one row in one 
sub-array can be refreshed while responding to an access request in another 
sub-array. In a second embodiment, at least one non-array row (e.g., an 
SRAM row or a register), external to a set of DRAM sub-arrays, is used to 

30 allow a refresh of at least one row of its corresponding sub-array when the 
internal controller, as opposed to an external controller, determines that a 
refresh would be appropriate. The at least one non-array row may either be 
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either direct mapped or fully associative, and the size of the non-array row 
may be smaller than, larger than, or equal to the size of each of the plural 
array rows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 A more complete appreciation of the invention and many of the 

attendant advantages thereof will be readily obtained as the same becomes 
better understood by reference to the following detailed description when 
considered in connection with the accompanying drawings, wherein: 
Figure 1A is a schematic illustration of a pseudo-static memory 
10 architecture according to a first aspect of the present invention; 

Figure 1B is a schematic illustration of the pseudo-static memory 
architecture of Figure 1 A in which row registers and tag registers have been 
added; 

Figure 2 is a timing diagram showing parallel read and refresh 
15 operations according to a first embodiment of the present invention; 

Figure 3 is a timing diagram showing parallel read and refresh 
operations according to a second embodiment of the present invention; 

Figure 4 is a timing diagram showing parallel read and refresh 
operations according to a third embodiment of the present invention; 

20 Figure 5 is a schematic illustration of a pseudo-static memory 

architecture according to a second aspect of the present invention; 

Figure 6 is a timing diagram showing parallel read and refresh 
operations according to a fourth embodiment of the present invention; 

Figure 7 is a schematic illustration of a pseudo-static memory 
25 architecture according to a third aspect of the present invention; and 

Figure 8 is a timing diagram showing parallel read and refresh 
operations according to a sixth embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



Referring now to the drawings, in which like reference numerals 
designate identical or corresponding parts throughout the several views, 
Figure 1 A is an illustration of a pseudo-static memory architecture according 
5 to a first aspect of a first embodiment of the present invention. Generally, the 
present invention includes control circuitry for performing a refresh operation 
in at least a first DRAM sub-array when a second DRAM sub-array is being 
accessed (for reading or writing). 

Turning now to Figure 1B, in the second aspect, like the memory 
10 architecture shown in Figure 7 of the '31 7 patent, a pseudo-static memory 
device includes both plural DRAM sub-arrays and at least one row (e.g., an 
SRAM row) coupled to the plural DRAM sub-arrays. The at least one row can 
act as an intermediate storage area for at least one of the plural DRAM 
sub-arrays when reading from or writing to that sub-array while 
15 contemporaneously refreshing a different DRAM sub-array. 

For example, as illustrated in Figure 2, a read operation corresponding 
to a memory location in the second row of the first DRAM sub-array 
(designated "DSAi") creates a row miss since the last read row for DSAi 
(labeled "LRRi") indicates that the last read row was row zero. Since the data 

20 is not already loaded into the row corresponding to DSAi, the control circuitry 
of the first embodiment begins the process of loading the row corresponding 
to DSAi with the data of row zero. In parallel, the control circuitry of the first 
embodiment begins to initiate a refresh operation corresponding to at least 
one row in the remaining DRAM sub-arrays (i.e., in either DSA 2 or DSA 3 or 

25 both). By running a refresh cycle concurrently with an access cycle, it can be 
insured that the refresh cycle is not interrupted by an access to the same 
DRAM sub-array. 

In this first embodiment, the address of the row to be refreshed is 
supplied from a standard refresh counter, labeled RC (g i 0 bai) in Figure 2, during 
30 every DRAM access cycle that causes a read (or write) miss. As shown, 

when DSAi is processing a row read miss and filling the first row, R-i, then the 
contents of the refresh counter, RC, are read, indicating that row 6 should be 

4 

\\\DE - 80412/1 -#110472 v4 



refreshed in parallel. At the end of the combined read/refresh cycle, the first 
row, R-i, contains the data corresponding to row 2, and the refresh counter, 
RC, contains the address of the next row to be refreshed (i.e., row 7). 

The approach illustrated in Figure 2, however, may adversely waste 
5 power by running refreshes excessively often. Consequently, in a second 
embodiment of the present invention shown in Figure 3, the pseudo-static 
memory device determines whether or not an appropriate amount of time has 
elapsed since the last refresh cycle. A refresh cycle is run behind the given 
access cycle only if the time has expired. As shown in Figure 3, consecutive 

10 read misses occur for rows 1-4 of DSAi, thereby updating Ri and LRRi after 
each miss. Unlike the timing diagram of Figure 2, on the first read miss, a 
refresh cycle of at least one other sub-array does not occur since the timer 
has not yet decremented to zero. Instead, each clock cycle (either internal or 
external) the timer is decremented, thus RC( g i 0 bai) remains constant until the 

15 timer hits zero. In one implementation, the rollover of the counter sets a 
"refresh pending" flag, and the timer is allowed to decrement again 
immediately. In an alternate implementation, the timer is held at zero until the 
refresh occurs. In either case, the timer is eventually reset (e.g., reset to its 
maximum value if the timer is a down counter) to signal the length of the next 

20 period to wait.) 

In Figure 3, it is not until the fourth row miss that the timer equals zero 
and a refresh cycle is initiated in parallel with a next row (e.g., read) miss. 
After performing the refresh, RC (g iobai) is incremented to its next value (i.e., 7). 

As shown in Figure 4, a third embodiment of the present invention 
25 includes both a counter and a timer. The counter acts as a running total of 
the number of refresh cycles that were missed because a hidden refresh did 
not occur recently and is referred to herein as a "missed refresh counter" 
(hereinafter "MRC"). In that configuration, a timer is coupled to an internal or 
external clock signal, and the value stored in MRC is incremented every time 
30 the timer resets. While the value stored in MRC is zero, the third embodiment 
acts like the embodiment of Figure 3. However, after MRC accumulates at 
least one missed refresh cycle, the control circuitry provides a hidden refresh 
cycle during the next opportunity, to a block other than the one requested by 
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the refresh address, regardless of the value of the timer. After performing the 
refresh cycle, the value in MRC is decremented to indicate that the control 
circuitry has "caught up" by one refresh cycle. Subsequent hidden refreshes 
occur again when possible until the value in MRC is decremented to zero. In 
5 a variation of the third embodiment, MRC is used to implement a burst of 
refreshes, as needed, upon entry into any device mode when internally 
initiated refreshes are allowed (e.g., a sleep mode). 

It should be noted that the ability to hide a refresh cycle behind an 
access is contingent upon the ability to have the refresh cycle occur for an 

10 address in a different DRAM sub-array than the sub-array where the access is 
occurring. However, if a series of accesses are directed to a first DRAM 
sub-array, then the other sub-arrays are being refreshed properly, but the first 
sub-array is not. Accordingly, as shown in Figure 5, a fourth embodiment of 
the present invention includes separate refresh counters for each sub-array. 

15 This prevents a row in the first sub-array from being "skipped" when the 

corresponding row is refreshed in the other sub-arrays. As shown in Figure 6, 
when a read miss occurs in DSA-i, refreshes in DSA 2 and DSA 3 are performed 
and their corresponding refresh counters (i.e., RC 2 and RC 3 ) are updated. 
However, the value stored in RCi is left unchanged, so that no rows in DSAi 

20 are skipped for refresh. 

In a fifth embodiment of the present invention, in addition to having a 
dedicated refresh counter per sub-array, each sub-array further includes a 
missed refresh counter (MRC). By tracking how far behind any sub-array is, 
each sub-array can "catch up" on missed refresh cycles without refreshing a 

25 row in all the sub-arrays, which would otherwise expend excess energy. For 
example, if a first sub-array (of four sub-arrays) is behind three cycles, a 
second sub-array is behind two cycles, and a third sub-array is behind one 
cycle, all three sub-arrays can "catch up" in parallel if the next read miss is to 
the sub-array that is not behind. After decrementing the corresponding 

30 MRCs, only two sub-arrays will be behind. Those remaining two sub-arrays 
can be updated when possible, and, if it was possible to update those two 
sub-arrays simultaneously, the last sub-array is updated by itself 
subsequently. 
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The embodiments above described can logically be considered an 
n-way grouping (e.g., 3-way grouping in Figures 1A and 1B) with a single 
DRAM sub-array per group. However, the method and structure of the 
present invention can be expanded to include groupings with plural sub-arrays 
5 per group, as shown in Figure 7. In such a hierarchical embodiment, group 
refreshes can be performed (1) one sub-array per group per refresh cycle, (2) 
plural, but not all, sub-arrays per group per refresh cycle, or (3) all sub-arrays 
per group per refresh cycle. It is also possible to select a first one of three 
group refreshing techniques for one group while selecting a second group 

10 refreshing technique for a second group. Moreover, the groups need not be 
refreshed at the same time. It is possible to either refresh all groups 
simultaneously (with each group refreshing at least one sub-array), or refresh 
individual groups individually based on the needs of that group. It is to be 
understood that attempting to refresh all sub-arrays simultaneously may lead 

15 to excessive current draw. As a result, the preferred embodiment does not 
refresh all possible sub-arrays of all groups simultaneously. Moreover, the 
hierarchy is not limited to a second-order hierarchy (i.e., a hierarchy of groups 
and sub-arrays). Any number of sub-arrays can be formed into a sub-group, 
and plural sub-groups can be formed into a group, with plural groups being 

20 formed into a super-group, etc. 

In the most complex refreshing technique of a second-order hierarchy, 
each sub-array of each group includes a refresh counter (RCjj) and a 
corresponding missed refresh counter (MRCj j). Thus, in the embodiment 
illustrated in Figure 7, on two consecutive row read misses corresponding to 

25 DSA41 , it is possible to perform two consecutive sets of refresh operations. 
In parallel with the first row read miss, the following rows are illustratively 
refreshed: the row referenced by RC-| \ of DSA-] \ , the row referenced by 
RC 2,2 of DSA2,2. both of the rows referenced by RC31 of DSA31 and 
RC3 2 of DSA3 2, and the row referenced by RC42 of DSA4 2, (resulting in a 

30 value of zero in MRC4 2)- For each of the RCj j's that were accessed, their 
values are incremented by one. Then, in parallel with the second row read 
miss, the following rows are illustratively refreshed: the row referenced by 



7 



RC-| 2 of DSA-i 2, the row referenced by RC2J of DSA2J , and both of the 
rows referenced by RC31 of DSA3 1 and RC32 of DSA32- It is noted that 
the row referenced by RC42 of DSA42 is not refreshed unless the timer is 
zero since DSA42 has caught up to ali missed refreshes. 

5 As shown in Figure 8, a sixth embodiment of the present invention 

analyzes the type of command to be performed to further hide at least one 
refresh cycle for the sub-array being addressed. In a burst read operation 
that produces a row read miss, data is read from a DRAM sub-array (DSAj) 
and loaded into a corresponding row (Rj). Since the burst read is guaranteed 

10 to perform plural consecutive reads, an interruption-free refresh operation can 
be performed on DSAj since Rj is providing the data for the burst. In the 
illustrated example, the four data words (or bits) are output in parallel with a 
refresh of the next row in DSAj, but the refresh is performed serially as 
compared to the row filling operation. (This type of refresh operation is 

15 referred to hereinafter as a "serial refresh operation.") By extending the 

number of words (or bits) output in any burst, the number of rows that can be 
serially refreshed per burst increases. For example, it may be possible to 
hide at least two serial refresh cycles behind a burst read of 8 words (or bits). 

Moreover, a burst write operation may likewise provide an opportunity 
20 for serial refresh operations. While a row Rj is being filled with data 

corresponding to a burst write, at least one row (depending on the size of the 
burst) of DSAj can be refreshed. 

In a seventh embodiment of the present invention, the control circuitry 
for performing parallel refreshes and the control circuitry for performing serial 

25 refreshes is combined to provide a high number of refreshed rows in burst 
accesses. In addition to the refresh operations that can be performed in the 
first through fifth embodiments, additional refresh operations of non-accessed 
sub-arrays can be performed in parallel with the serial refresh operations. For 
example, in an n-way grouping with one sub-array per group, while Rj is being 

30 filled by DSAj, a maximum of n-1 refresh operations can be performed in 

parallel for DSAj where i * j. Then, during the burst read, one row for, at most, 
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each of the n sub-arrays at a time can be refreshed while data is read from Rj, 
but fewer rows can be refreshed if a power consumption checking circuit 
determines that a maximum power (or current) draw would be exceeded. 

If a write row is provided as well, the opposite refreshing schedule 
5 would be used during a burst write operation. That is, a maximum of n rows 
could be refreshed while the data is being written to Rj, then a maximum of 
n-1 refresh operations at a time could be performed in parallel with writing the 
data from Rj to DSAj. 

In order to reduce the possibility that any one sub-array will become 
10 too far behind in its refreshes, in a variation of the first through seventh 

embodiments disclosed herein, the address decoders are configured to put 
logically adjacent rows in different sub-arrays. For example, in a row of 128 
bits, binary addresses XXX00XXXXXXX are stored in a first sub-array, binary 
addresses XXX01XXXXXXX are stored in a second sub-array, binary 
15 addresses XXX10XXXXXXX are stored in a third sub-array, and binary 
addresses XXX1 1XXXXXXX are stored in a fourth sub-array, where "X" 
represents a "don't care" in the address. Thus, by consecutively referencing 
all memory locations between 000000000 and 111111111111, the memory 
device will cycle between sub-arrays 0, 1 , 2, and 3 and then return to zero 
20 eight times. Using a linear addressing scheme, 1024 consecutive operations 
would occur for DSA-| followed by 1024 consecutive operations for DSA2, 
etc., and data could be lost during those bursts. 

The present invention can utilize a number of different conditions to 
trigger an internal examination as to whether a refresh cycle should be 

25 performed. The memory device receives commands (e.g., in the form of an 
explicit command sent to the memory or in the form of the assertion or de- 
assertion of a signal on an external pin) that are decoded internally by the 
memory device. For example, a read command issued to the memory device 
can be decoded to determine if, for example, (1) if it is time to hide a refresh 

30 behind a read from a non-array row or (2) if it is time to hide a refresh of an 
array row of a first sub-array behind an access to an array row of a second 
sub-array. Similarly, upon receipt of a command in the form of a refresh 
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signal on a refresh pin, the memory device may decide internally that an 
insufficient amount of time has passed (or that power considerations would 
make it inadvisable to perform a refresh at the requested time), and the 
memory device blocks a refresh from occurring in response to that command. 
5 Other commands that can be decoded include, but are not limited to, write 
requests and chip deselects. 

Obviously, numerous modifications and variations of the present 
invention are possible in light of the above teachings. It is therefore to be 
understood that, within the scope of the appended claims, the invention may 
10 be practiced otherwise than as specifically described herein. 
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